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Abstract 



Various new physics models predict a light CP-odd Higgs boson (labeled as a) and open up new 
decay modes for Z-boson, such as Z — > ffa, Z — > cry and Z — > aaa, which could be explored at 
the GigaZ option of the ILC. In this work we investigate these rare decays in several new physics 
models, namely the type-II two Higgs doublet model (type-II 2HDM), the lepton-specific two 



Higgs doublet model (L2HDM), the nearly minimal supersymetric standard model (nMSSM) and 
the next-to-minimal supersymmetric standard model (NMSSM). We find that in the parameter 
space allowed by current experiments, the branching ratios can reach 10 for Z — > ffa (/ = b, r), 
10 -9 for Z — > 07 and 10~ 3 for Z — > aaa, which implies that the decays Z — > ffa and Z — > aaa 
may be accessible at the GigaZ option. Moreover, since different models predict different patterns 
of the branching ratios, the measurement of these rare decays at the GigaZ may be utilized to 
distinguish the models. 

><' 
C^ ■ PACS numbers: 13.38.Dg,12.60.Fr,14.80.Da 



I. INTRODUCTION 

The LEP experiments at the resonance of Z-boson have tested the Standard Model (SM) 
at quantum level, measuring the Z-decay into fermion pairs with an accuracy of one part in 
ten thousands. The good agreement of the LEP data with the SM predictions have severely 
constrained the behavior of new physics at the Z-pole. Taking these achievements into 
account one can imagine that the physics of Z-boson will again play the central role in the 
frontier of particle physics if the next generation Z factory comes true with the generated 
Z events several orders of magnitude higher than that of the LEP. This factory can be 



Q. 



The ILC is a 



realized in the GigaZ option of the International Linear Collider (ILC) 
proposed electron-positron collider with tunable energy ranging from 400GeV to 500GeV 
and polarized beams in its first phase, and the GigaZ option corresponds to its operation 
on top of the resonance of Z boson by adding a bypass to its main beam line. Given the 
high luminosity, £ = 7 x 10 m cm~ 2 s~ l , and the cross section at the resonance of Z boson, 
oz — 30nb, about 2 x 10 9 Z events can be generated in an operational year of 10 7 s of 
GigaZ, which implies that the expected sensitivity to the branching ratio of Z-decay can 
be improved from 10 -5 at the LEP to 1CT 8 at the GigaZ [lj. In light of this, the Z-boson 
properties, especially its exotic or rare decays which are widely believed to be sensitive to 
new physics, should be investigated comprehensively to evaluate their potential in probing 
new physics. 

Among the rare Z-decays, the flavor changing (FC) processes were most cxtcnsive.y 
studied to explore the flavor texture in new physics [2|, and it was found that, although these 
processes are severely suppressed in the SM, their branching ratios in new physics models 
can be greatly enhanced to 10~ 8 for lepton flavor violation decays |3[ and 10 -6 for quark 



a. 



flavor violation decays [4|. Besides the FC processes, the Z-decay into light Higgs boson(s) 
is another type of rare process that was widely studied, e.g. the decay Z — > f fa (/ = b, r) 
with the particle a denoting a light Higgs boson was studied in [5], the decay Z — y 07 
was studied in the two Higgs doublet model (2HDM)|6] and the minimal supersymmetric 
standard model (MSSM)[7||, and the decay Z — y aaa was studied in a model independent 



way |8j, in 2HDM[9|, [1Q| and also in MSSMjllJ. These studies indicate that, in contrast 



with the kinematic forbidden of these decays in the SM, the rates of these decays can be 
as large as 10~ 5 in new physics models, which lie within the expected sensitivity of the 



GigaZ. In this work, we extend the previous studies of these decays to some new models 
and investigate these decays altogether. We are motivated by some recent studies on the 
singlet extension of the MSSM, such as the next-to-minimal supersymmetric standard model 
(NMSSM) [12], ll3( and the nearly minimal supersymmetric standard model (nMSSM) |l4j . 
where a light CP-odd Higgs boson a with singlet-dominant component may naturally arise 
from the spontaneous breaking of some approximate global symmetry like Ur(1) or Peccei- 



Quuin symmetry 15Hl7j]. These non- minimal supersymmetric models can not only avoid 



the /x-problem, but also alleviate the little hierarchy by having such a light Higgs boson 



a 18]. We are also motivated by that, with the latest experiments, the properties of the 
light Higgs boson are more stringently constrained than before. So it is worth updating the 
previous studies. 

So far there is no model-independent lower bound on the lightest Higgs boson mass. In 
the SM, it must be heavier than 114 GeV, obtained from the null observation of the Higgs 
boson at LEP experiments. However, due to the more complex structure of the Higgs sector 
in the extensions of the SM, this lower bound can be significantly relaxed according to recent 



studies, e.g., for the CP-odd Higgs boson a we have m a >l GeV in the nMSSM [191], m rt >0.21 



GeV in the NMSSM [16|, and m a >7 GeV in the lepton-specific 2HDM (L2HDM) [20|. With 
such a light CP-odd Higgs boson, the Z-decay into one or more a is open up. Noting that the 
decay Z — > aa is forbidden due to Bose symmetry, we in this work study the rare Z-decays 
Z — > f fa (f = b, t)^Z — > 07 and Z — > aaa in a comparative way for four models, namely 



the Type-II 2HDM[2l|, the L2HDM [22|, |23(, the nMSSM and the NMSSM. In our study, 
we examine carefully the constraints on the light a from many latest experimental results. 
This work is organized as follows. In Sec. II we briefly describe the four new physics 
models. In Sec. Ill we present the calculations of the rare Z-decays. In Sec. IV we list the 
constraints on the four new physics models. In Sec. V we show the numerical results for the 
branching ratios of the rare Z-decays in various models. Finally, the conclusion is given in 
Sec. VI. 

II. THE NEW PHYSICS MODELS 

As the most economical way, the SM utilizes one Higgs doublet to break the electroweak 
symmetry. As a result, the SM predicts only one physical Higgs boson with its properties 
totally determined by two free parameters. In new physics models, the Higgs sector is usually 



extended by adding Higgs doublets and/or singlets, and consequently, more physical Higgs 
bosons are predicted along with more free parameters involved in. 

The general 2HDM contains two SU(2)l doublet Higgs fields </>i and (b^. and with the 
assumption of CP-conserving, its scalar potential can be parameterized as|21|: 

V = m&lfa + m\<\>\<\> 2 - (m&lfo + H.c.) + y (^i) 2 + y (0 2 2 ) 2 

+A 3 (0l0i)(0^ 2 ) + A 4 (0i0 2 )(0^i) + y [(0l0 2 ) 2 + H.c.}, (1) 

where Aj (i = 1, ■ • • ,5) are free dimensionless parameters, and m, (i = 1,2,3) are the 
parameters with mass dimension. After the electroweak symmetry breaking, the spectrum 
of this Higgs sector includes three massless Goldstone modes, which become the longitudinal 
modes of W and Z bosons, and five massive physical states: two CP-even Higgs bosons hi 
and h 2 , one neutral CP-odd Higgs particle a and a pair of charged Higgs bosons H . Noting 
the constraint v \ + v% = (246 GeV) 2 with v± and u 2 denoting the vacuum expectation values 
(vev) of 0i and 2 respectively, we choose 

m hl , m h2 , m a , m H ±, tan/3, sin a, A 5 (2) 

as the input parameters with tan/3 = f 2 /t>i, and a being the mixing angle that diagonalizes 
the mass matrix of the CP-even Higgs fields. 

The difference between the Type-II 2HDM and the L2HDM comes from the Yukawa 
coupling of the Higgs bosons to quark/lepton. In the Type-II 2HDM, one Higgs doublet <p2 
generates the masses of up-type quarks and the other doublet <p\ generates the masses of 
down-type quarks and charged leptons; while in the L2HDM one Higgs doublet </>i couples 
only to leptons and the other doublet 2 couples only to quarks. So the Yukawa interactions 



of a to fermions in these two models are given by 
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r Type-II igm-Ui , o- 5 , l 9 m <k , nl 5, , l 9 ra e l Q - 5 /q\ 

^Yukawa = o COt P Ui ^ UiCi + O t&11 ^"^ " iCl + O taI1 P Gi ^ ei °' ( 3 ) 

ZTUW 2m\y iTTlyi/ 

£™ a = f^ cot Pu a 5 u t a - % -P± cot fdrf %a + |^ tan /3e- 7 5 e 4 a, (4) 

2m w 2m w 2m w 

with i denoting generation index. Obviously, in the Type-II 2HDM the bba coupling and 
the fra coupling can be simultaneously enhanced by tan/3, while in the L2HDM only the 
fra coupling is enhanced by tan/3. 



The structures of the nMSSM and the NMSSM are described by their superpotentials 
and corresponding soft-breaking terms, which are given by [24| 
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W MSSM + XH U ■ H d S + &M 2 S, (5) 

Wmssm + \H u -H d S+^KS*, (6) 

rh 2 u \H u \ 2 + m 2 d \H d \ 2 + m 2 s \S\ 2 + (A X XSH U ■ H d + £ S M*S + h.c), (7) 

m 2 u \H U \ 2 + m 2 d \H d \ 2 + m 2 s \S\ 2 + (A X XSH U ■ H d + ^kS 3 + h.c), (8) 



where VFmssm is the superpotential of the MSSM without the fi term, H Ujd and S are Higgs 
doublet and singlet superfields with H ud and 5* being their scalar component respectively, 
m u , m d , rhs, A\, A K and ^M^ are soft breaking parameters, and A and k are coefficients 
of the Higgs self interactions. 

With the superpotentials and the soft-breaking terms, one can get the Higgs potentials of 
the nMSSM and the NMSSM respectively. Like the 2HDM, the Higgs bosons with same CP 
property will mix and the mass eigenstates are obtained by diagonalizing the corresponding 
mass matrices: 
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(9) 



where the fields on the right hands of the equations are component fields of H u , H d and S 
defined by 



H d 



vd+4>d+iy>d 
H7 



H u 



V2 



S = ^=(s + a + tO, (10) 



hi, h 2 , h 3 and a, A are respectively the CP-even and CP-odd neutral Higgs bosons, G° and 
G + are Goldstone bosons eaten by Z and W + , and H + is the charged Higgs boson. So both 
the nMSSM and NMSSM predict three CP-even Higgs bosons, two CP-odd Higgs bosons 
and one pair of charged Higgs bosons. In general, the lighter CP-odd Higgs a in these model 
is the mixture of the singlet field £ and the doublet field combination, cos (3<p u + sin {3ip d , i.e. 



cos 6a£, + sin 6 A (cos /3(f u + sin /3(p d ) , 



(11) 



and its couplings to down-type quarks are then proportional to ^— - tan /3 sin 0^- So for 



mil- 



singlet dominated a, sin 9a is small and the couplings are suppressed. As a comparison, the 



interactions of a with the squarks are given by 12| 



£ 



aq"q 



-igm u 
igm d 



2m 



a - 



(At; cot /3 cos 9a + A u cot /3 sin 9a — H sin 9a) (u* r ul — u* L UR)a 

(Xv tan /3 cos 6* a + Ad tan /3 sin 9 a — f^ sin 9a) {d R dh — d* L dn)a, (12) 



i.e. the interaction does not vanish when sin^ approaches zero. Just like the 2HDM 
where we use the vevs of the Higgs fields as fundamental parameters, we choose A, k, tan/3, 
jj, e ff = X(S), A K and m A = ~^zs(A\ + ^) as input parameters for the NMSSMJ24J and 



sin 2/3 ( 



A, tan/3 



nMSSM[19|. 



/i 



; // = X(S), A x , rh s and 



m. 



sin 2/3 



(fiAx + X£fM%) as input parameters for the 



About the nMSSM and the NMSSM, three points should be noted. The first is for the 
two models, there is no explicit /x— term, and the effective \x parameter (fi e s) is generated 
when the scalar component of S develops a vev. The second is, the nMSSM is actually same 



as the NMSSM with k = 



191 ]. because the tadpole terms £,fM%S and its soft breaking 



term t^sM^S in the nMSSM do not induce any interactions, except for the tree-level Higgs 
boson masses and the minimization conditions. And the last is despite of the similarities, 
the nMSSM has its own peculiarity, which comes from its neutralino sector. In the basis 

n 

(—iX', —iX 3 ,^ jifjfl ,ips)i its neutralino mass matrix is given by |14| 

/ Mi D m.vS-ixrSi. —m.^Surr.i, D \ 



Mi m z swSb —m z swCb 

M 2 —m z cwSb mzCwCb 

ITLzSy/Sb —TTtzCwSb — \x —Xvcb 

—m z s w Cb m z c w Cb —fi — Xvs b 

— Xvch —Xvsh 



(13) 



where M 1 and M 2 are U{\) and SU(2) gaugino masses respectively, sw = sin9w, cw — 
cos#vK 5 Sb = sin/3 and q, = cos/3. After diagonalizing this matrix one can get the mass 
eigenstate of the lightest neutralino Xi with mass taking the following form [25 ] 

2fiX 2 {vl + v 2 d ) tan/3 



Xi 



(14) 



2^ + X 2 (vl + vj)tan 2 (3 + l 

This expression implies that Xi must be lighter than about 60 GeV for \x > lOOGeV (from 
lower bound on chargnio mass) and A < 0.7 (perturbativity bound). Like the other super- 
symmetric models, Xi as t ne lightest sparticle acts as the dark matter in the universe, but 
due to its singlino-dominated nature, it is difficult to annihilate sufficiently to get the correct 



density in the current universe. So the relic density of Xi plays a crucial way in selecting 
the model parameters. For example, as shown in |19|, for xi > 37GeV, there is no way to 
get the correct relic density, and for the other cases, Xi mainly annihilates by exchanging 
Z boson for 30GeV < m^o < 37GeV , or by exchanging a light CP-odd Higgs boson a with 
mass satisfying the relation m a ~ 2m^o for m^o < 25GeV. For the annihilation, tan/3 and 
H are required to be less than 10 and 500GeV respectively because through Eq. (fl4j) a large 
tan/3 or jjl will suppress m^a to make the annihilation more difficult. The properties of the 
lightest CP-odd Higgs boson a, such as its mass and couplings, are also limited tightly since 
a plays an important role in Xi annihilation. The phenomenology of the nMSSM is also 
rather special, and this was discussed in detail in [19] . 



III. CALCULATIONS 
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(a) (b) (c) 

FIG. 1: Feynman diagrams contributing to the decay Z — > ffa (f = b,r) in new physics models. 

h denotes all possible intermediate CP-even Higgs bosons in the corresponding model. 
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,a) (b) 

FIG. 2: Feynman diagrams contributing to the decay Z — > 07 at one-loop level in new physics 
models. Note the chargino loop diagrams only exist in the nMSSM and NMSSM. 



In the Type-II 2HDM, L2HDM, nMSSM and NMSSM, the rare Z-decays Z ->■ ffa 
(/ = b,r), Z — >■ 07 and Z — > aaa may proceed by the Feynman diagrams shown in FigJTJ 
FigfS] and Fig]3] respectively. For these diagrams, the intermediate state h represents all 
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FIG. 3: Feynman diagrams contributing to the decay Z — y aaa in new physics models. Only the 
correction from the Higgs-mediated loops are considered since the other corrections can be safely 
neglected (see the arguments in the text). 

possible CP-even Higgs bosons in the corresponding model, i.e. h\ and /12 m Type- 1 1 2HDM 
and L2HDM and hi, hi and /13 in nMSSM and NMSSM. In order to take into account the 
possible resonance effects of h in FigOJc) for Z — > f fa and Figj3] (a) for Z — > aaa, we have 
calculated all the decay modes of h and properly included the width effect in its propagator. 
As to the decay Z — ¥ 07, two points should be noted. One is, unlike the decays Z — > f fa 
and Z — y aaa, this process proceeds only through loops mediated by quarks/leptons in the 
Type-II 2HDM and L2HDM, and additionally by sparticles in the nMSSM and NMSSM. 
So in most cases its rate should be much smaller than the other two. The other is due to 
CP-invariance, loops mediated by squarks/sleptons give no contribution to the decay [7]. In 
actual calculation, this is reflected by the fact that the coupling coefficient of q^qLa differs 
from that of q* L qna by a minus sign (see Eq.(TT2l). and as a result, the squark-mediated 
contributions to Z — y 07 are completely canceled out. 

With regard to the rare decay Z —y aaa, we have more explanations. In the lowest 
order, this decay proceeds by the diagram shown in Figj3] (a), and hence one may think 
that, as a rough estimate, it is enough to only consider the contributions from Figj3]^a). 
However, we note that in some cases of the Type-II 2HDM and L2HDM, due to the can- 
celation of the contributions from different h in Figj3] (a) and also due to the potentially 



largeness of haa couplings (i.e. larger than the electroweak scale v), the radiative correc- 
tion from the Higgs-mediated loops may dominate over the tree level contribution even 
when the tree level prediction of the rate, Br tree (Z — > aaa), exceeds 1CT 6 . On the other 
hand, we find the contribution from quark/lepton-mediated loops can be safely neglected if 
Br tree (Z -> aaa) > 10~ 8 in the Type-II 2HDM and the L2HDM. In the nMSSM and the 
NMSSM, besides the corrections from the Higgs- and quark/lepton-mediated loops, loops 
involving sparticles such as squarks, charginos and neutralinos can also contribute to the 
decay. We numerically checked that the contributions from squarks and charginos can be 
safely neglected if Br tree (Z —¥ aaa) > 1CT 8 . We also calculated part of potentially large 
neutralino correction (note that there are totally about 5 4 diagrams for such correction!) 
and found they can be neglected too. Since considering all the radiative corrections will 
make our numerical calculation rather slow, we only include the most important correction, 
namely that from Higgs-mediated loops, in presenting our results for the four models. 

One can intuitively understand the relative smallness of the sparticle contribution to 
Z —?• aaa as follows. First consider the squark contribution which is induced by the Zq*q 
interaction (q denotes the squark in chirality state) and the q*qa interaction through box 
diagrams. Because the Zq*q interaction conserves the chirality of the squarks while the 
q*qa interaction violates the chirality, to get non-zero contribution to Z — > aaa from the 
squark loops, at least four chiral flippings are needed, with three of them provided by q*qa 
interaction and the rest provided by the left-right squark mixing. This means that, if one 
calculates the amplitude in the chirality basis with the mass insertion method, the amplitude 
is suppressed by the mixing factor m % g with m q X q being the off diagonal element in squark 
mass matrix. Next consider the chargino/neutralino contributions. Since for a light a, 
its doublet component, parameterized by sin #,4 in Eq. ffTTl, i s usually small, the couplings 
of a with the sparticles will never be tremendously large 12J. So the chargino/neutralino 
contributions are not important too. In our calculation of the decays, we work in the mass 
eigenstates of sparticles instead of in the chirality basis. 

IV. CONSTRAINTS ON THE NEW PHYSICS MODELS 



For the Type-II 2HDM and the L2HDM, we consider the following constraints 20J : 



'1) Theoretical constraints on Aj from perturbativity, unitarity and requirements that the 



scalar potential is finit at large field values and contains no flat directions 2l|, |26J . 
which imply that 



A 4 <4?r (i = 1,5), A lj2 >0, A 3 > -VA1A2, A3 + A4- |A 5 | > -v 7 ^^, 

3(Ai + A 2 ) ± v/9(Ai-A 2 ) 2 + 4(2A3 + A 4 ) 2 < 16tt, 

Ai + A 2 ± V /(A 1 -A 2 ) 2 + 4|A 4 | 2 < 16tt, 

Ai + A 2 ± v / (Ai-A 2 ) 2 + 4|A 5 | 2 < 16tt, 

A 3 + 2A 4 ±3|A 5 | < 8vr, A 3 ± A 4 < 8tt, A 3 ± |A 5 | < 8tt. (15) 

(2) The constraints from the LEP search for neutral Higgs bosons. We compute the 
signals from the Higgs^strahlung production e + e~ — > Zhi (i = 1,2) with hi — y 



26, 2r, 46, 4r, 262r 



27 



29| and from the associated production e + e~ — y hid with 
/ija — y 46, 4r, 262r, 66, 6r |30j , and compare them with the corresponding LEP data 
which have been inputted into our code. We also consider the constraints from 



e + e — y Zhi by looking for a peak of M^. recoil mass distribution of Z-boson 31 ] 



and the constraint of T(Z — y hid) < 5.8 MeV when m a + m^. < irtz 32]. 

These constraints limit the quantities such as C^j = \dzzhj OzzHsm^ x Br(hi — y 66) on 
the C 2 jj — rrihi plane with the the subscript gzzhi denoting the coupling coefficient of 
the ZZhi interaction. They also impose a mo del- dependent lower bound on m h , e.g., 



70GeV for the Type-II 2HDM (from our scan results), 50GeV for the L2HDM[20(, and 
30GeV for the nMSSM [l9|. These bounds are significantly lower than that of the SM, 
i.e. 114GeV, partially because in new physics models, unconventional decay modes of 
hi such as hi —y aa are open up. As to the nMSSM, another specific reason for allowing 
a significantly lighter CP-even Higgs boson is that the boson may be singlet-dominated 
in this model. 

With regard to the lightest CP-odd Higgs boson a, we checked that there is no lower 
bound on its mass so long as the Zhia interaction is weak or hi is sufficiently heavy. 



(3) The constraints from the LEP search for a light Higgs 



Doson via the Yukawa process 



e + e — y ffS with f = b,r and S denoting a scalar [33[]. These constraints can limit 
the ffS coupling versus ms in new physics models. 

(4) The constraints from the CLEO-III limit on Br(T(lS) — y 07 — y t + t~'j) and the latest 

10 



BaBar limits on Br(T(3S) — > 07 — > r + r~7,/i + /i~7). These constraints will put very 
tight constraints on the abb coupling for m a < 9GeV. In our analysis, we use the 
results of Fig. 8 in the second paper of [17] to excluded the unfavored points. 

(5) The constraints from Zt + t~ couplings. Since the Higgs sector can give sizable higher 
order corrections to Zt + t~ couplings, we calculate them to one loop level and require 
the corrected Zt + t~ couplings to lie within the 2er range of their fitted value. The 
SM predictions for the couplings at Z-pole are given by g v M = —0.03712 and g^ = 
-0.50127 |34J, and the fitted values are given by -0.0366 ± 0.00245 and -0.50204 ± 
0.00064, respectively 34]. We adopt the formula in 35] to the 2HDM in our calculation. 



(6) The constraints from r leptonic decay. We require the new physics correction to the 
branching ratio Br{r — > ez/ e z/ T ) to be in the range of —0.80% ~ 1.21% 36]. We use 



the formula in 



in our calculation. 



About the constraints (5) and (6), two points should be noted. One is all Higgs 
bosons are involved in the constraints by entering the self energy of r lepton, the 
Ztt vertex correction or the Wfv T vertex correction, and also the box diagrams for 



r — >■ ez/ e z/ T [35|, |36|. Since the Yukawa couplings of the Higgs bosons to r lepton get 



enhanced by tan/3 and so do the corrections, tan/3 must be upper bounded for given 
spectrum of the Higgs sector. Generally speaking, the lighter a is, the more tightly 



tan/3 is limited 



20 



The other point is in the Type-II 2HDM, Rb, B-physics 
observables as well as T decays discussed above can constraint the model in a tighter 
way than the constraints (5) and (6) since the Yukawa couplings of r lepton and b 
quark are simultaneously enhanced by tan/3. But for the L2HDM, because only the 
Yukawa couplings of r lepton get enhanced (see EqHJ, the constraints (5) and (6) are 
more important in limiting tan/3. 

(7) Indirect constraints from the precision electroweak observables such as pi, sin 2 9 e e , f and 
M w , or their combinations e,(2 = 1, 2, 3) J37j. We require q to be compatible with the 
LEP/SLD data at 95% confidence level [341] . We also require new physics prediction 
of Rb = T(Z — y bb)/T(Z — y hadrons) is within the la range of its experimental 



value. The latest results for Rb are R e b xp = 0.21629 
0.21578 (SM prediction) for m t = 173 GeV 



R SM 



0.00066 (measured value) and 
. In our code, we adopt the 



11 



formula for these observables presented in 35] to the Type-II 2HDM and the L2HDM 
respectively. 

In calculating pe, sin 2 6^ and M\y, we note that these observables get dominant 

contributions from the self energies of the gauge bosons Z, W and 7. Since there is no 

Zaa coupling or 70a coupling, a must be associated with the other Higgs bosons to 

contribute to the self energies. So by the UV convergence of these quantities, one can 

infer that, for the case of a light a and rrih^m H ± ^> m z , these quantities depend on the 

2 

m h 

spectrum of the Higgs sector in a way like In 3 ' at leading order, which implies that 
a light a can still survive the constraints from the precision electroweak observables 



given the splitting between m^ and m H ± is moderate 20]. 



(8) The constraints from B physics observables such as the branching ratios for B — > X s 7, 
B s — > fi + fi~ and B + — > t + u t , and the mass differences AMd and AM S . We require 
their theoretical predications to agree with the corresponding experimental values at 
2<r level. 

In the Type-II 2HDM and the L2HDM, only the charged Higgs boson contributes 
to these observables by loops, so one can expect that m H ± versus tan/3 is to be 
limited. Combined analysis of the limits in the Type-II 2HDM has been done by the 
CKMfitter Group, and the lower bound of m#± as a function of tan/3 was given in 



Fig. 11 of 39]. This analysis indicates that m H ± must be heavier than 316GeV at 95% 



C.L. regardless the value of tan/3. In this work, we use the results of Fig.ll in 39| 



to exclude the unfavored points. As for the L2HDM, B physics actually can not put 
any constraints J40J because in this model the couplings of the charged Higgs boson to 
quarks are proportional to cot /3 and in the case of large tan /3 which we are interested 
in, they are suppressed. In our analysis of the L2HDM, we impose the LEP bound on 
m H ±, i.e. m H ± > 92GeV[4l|. 

(9) The constraints from the muon anomalous magnetic moment a M . Now both the theo- 
retical prediction and the experimental measured value of a M have reached a remarkab 



precision, but a significant deviation still exists: a e * p — a SM = (25.5 ±8.0) x 10 -10 42]. 
In the 2HDM, a M gets additional contributions from the one-loop diagrams induced 
by the Higgs bosons and also from the two-loop Barr-Zee diagrams mediated by a and 



hi 43j. If the Higgs bosons are much heavier than /1 lepton mass, the contributions 
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from the Barr-Zee diagrams are more important, and to efficiently alleviate the dis- 
crepancy of a M , one needs a light a along with its enhanced couplings to \i lepton and 
also to heavy fermions such as bottom quark and r lepton to push up the effects of the 
Barr-Zee diagram [43]. The CP-even Higgs bosons are usually preferred to be heavy 
since their contributions to a^ are negative. 

In the Type-II 2HDM, because tan/3 is tightly constrained by the process e + e~ — > bba 



at the LEP[33] and the T decay 17|, the Barr-Zee diagram contribution is insufficient to 



enhance a^ to 2a range around its measured value 44] . So in our analysis, we require 
the Type-II 2HDM to explain a^ at 3a level. While for the L2HDM, tan/3 is less 
constrained compared with the Type-II 2HDM, and the Barr-Zee diagram involving 
the r-loop is capable to push up greatly the theoretical prediction of a M [20j. Therefore, 
we require the L2HDM to explain the discrepancy at 2a level. 

Unlike the other constraints discussed above, the a^ constraint will put a two-sided 
bound on tan /3 since on the one hand, it needs a large tan /3 to enhance the Barr-Zee 
contribution, but on the other hand, too large tan/3 will result in an unacceptable 
large a M . 

(10) Since this paper concentrates on a light a, the decay hi — > aa is open up with a 
possible large decay width. We require the width of any Higgs boson to be smaller 
than its mass to avoid a too fat Higgs boson [id]. We checked that for the scenario 
characterized by m^/m^ > 3, the coefficient of hiaa interaction is usually larger than 
the electroweak scale v , and consequently a large decay width is resulted. 

For the nMSSM and NMSSM, the above constraints become more complicated because 
in these models, not only more Higgs bosons are involved in, but also sparticles enter the 
constraints. So it is not easy to understand some of the constraints intuitively. Take the 
process B — > X s ^ as an example. In the supersymmetric models, besides the charged Higgs 
contribution, chargino loops, gluino loops as well as neutralino loops also contribute to the 



process 45(], and depending on the SUSY parameters, any of these contributions may become 
dominated over or be canceled by other contributions. As a result, although the charged 
Higgs affects the process in the same way as that in the Type-II 2HDM, charged Higgs as 



light as 130GeV is still allowed even for tan /3 > 50 46] . 
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Since among the constraints, a M is rather peculiar in that it needs new physics to explain 
the discrepancy between a e ^ p and a^ M , we discuss more about its dependence on SUSY 
parameters. In the nMSSM and the NMSSM, a M receives contributions from Higgs loops and 
neutralino/chargino loops. For the Higgs contribution, it is quite similar to that of the Type- 
II 2HDM except that more Higgs bosons are involved in[47]. For the neutralino/chargino 



contribution, in the light bino limit (i.e. M\ <C M2,/x), it can be approximated by 48 1 



H, = 18tan/3 — -— ^nnnnT ^ (16) 



/lOOGeVV f jt-A^l \ 1rt _ l0 
V m A J V lOOOGeV 

for 171^ ~ m^ 2 = m^ = 2M\ with m^ being smuon mass. So combining the two contribu- 
tions together, one can learn that a light a along with large tan/3 and/or light smuon with 
moderate tan/3 are favored to dilute the discrepancy. 

Because more parameters are involved in the constraints on the supersymmetric models, 
we consider following additional constraints to further limit their parameters: 

(a) Direct bounds on sparticle masses from the LEP1, the LEP2 and the Tevatron exper- 
iments 



(b) The LEP1 bound on invisible Z decay T(Z ->• x\x\) < 1-76 MeV; the LEP2 bound 
on neutralino production <r(e + e~ —t XiXa) < 10~ 2 pb {i > 1) an d u(e + e~ — > XiX'j) < 
10- 1 pb (i,j > 1)|49|. 



(c) Dark matter constraints from the WMAP relic density 0.0975 < Vth 2 < 0.1213 [50]. 



Note that among the above constraints, the constraint (2) on Higgs sector and the con- 
straint (c) on neutralino sector are very important. This is because in the supersymmetric 
models, the SM-like Higgs is upper bounded by about lOOGeV at tree level and by about 
140GeV at loop level, and that the relic density restricts the LSP annihilation cross section 
in a certain narrow range. 

In our analysis of the NMSSM, we calculate the constraints (3) and (5-7) by ourselves 



and utilize the code NMSSMTools 

NMSSMTools to the nMSSM to implement the constraints. 

difficult thing we faced is how to adapt the code micrOMEGAs 



51] to implement the rest constraints. We also extend 

or the extension, the most 



52] to the nMSSM case. We 



solve this problem by noting the following facts: 
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As we mentioned before, the nMSSM is actually same as the NMSSM with the trilinear 
singlet term setting to zero. So we can utilize the model file of the NMSSM as the 
input of the micrOMEGAs and set k = 0. 

Since in the nMSSM, the LSP is too light to annihilate into Higgs pairs, there is no 
need to reconstruct the effective Higgs potential to calcula te p recisely the annihilation 



channel x?Xi ~~ >* SS with S denoting any of Higgs bosons 53]. 



We thank the authors of the NMSSMTools for helpful discussion on this issue when we finish 
such extension [191] . 



V. NUMERICAL RESULTS AND DISCUSSIONS 

With the above constraints, we perform four independent random scans over the param- 
eter space of the Type-II 2HDM, the L2HDM, the nMSSM and the NMSSM respectively. 
We vary the parameters in following ranges: 



1 < tan/3 < 80, - V2/2 < sin a < V2/2, m a < 30 GeV, A 5 < 4vr, 

5 GeV < m hlM < 500 GeV, 316 GeV < m H+ < 500 GeV (17) 



for the Type-II 2HDM, 



1 < tan/3 < 80, - v^/2 < sin a < n/2/2, m a < 30 GeV, A 5 < 4vr, 

5 GeV < m hlM < 500 GeV, 92GeV < m H+ < 500 GeV (18) 

for the L2HDM, 

0.1 < A < 0.7, 1 < tan/3 < 80, 100 GeV < m A < 1 TeV, 
50 GeV < ^ff, Mi < 500 GeV, - 1 TeV < A x < 1 TeV, < m s < 200GeV (19) 

for the nMSSM, and 

0.1 < A, k < 0.7, 1 < tan/3 < 80, 100 GeV < m A < 1 TeV, 
50 GeV < /i eff , M x < 500 GeV, - 100 GeV < A K < 100 GeV (20) 

for the NMSSM. 
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FIG. 4: The scattering plot of the surviving samples projected on m a — tan/3 plane. 

In performing the scans, we note that for the nMSSM and the NMSSM, some constraints 
also rely on the gaugino masses and the soft breaking parameters in the squark sector and 
the slepton sector. Since these parameters affect little on the properties of a, we fix them to 
reduce the number of free parameters in our scan. For the squark sector, we adopt the m™ ax 
scenario which assumes that the soft mass parameters for the third generation squarks are 



degenerate: M^ 



Qs 



M, 



u 3 



Md 3 = 800 GeV, and that the trilinear couplings of the third 



generation squarks are also degenerate, A t = A b with X t = A t — /zcot/3 = — 2Mq 3 . For the 
slepton sector, we assume all the soft-breaking masses and trilinear parameters to be 100 
GeV. This setting is necessary for the nMSSM since this model is difficult to explain the 
muon anomalous moment at 2<r level for heavy sleptons 19j . Finally, we assume the grand 
unification relation 3Mi/5ai = M 2 /a 2 = M 3 /a 3 for the gaugino masses with cyj being fine 
structure constants of the different gauge group. 

With large number of random points in the scans, we finally get about 3000, 5000, 800 and 
3000 samples for the Type-II 2HDM, the L2HDM, the nMSSM and the NMSSM respectively 
which survive the constraints and satisfy m a < 30GeV. Analyzing the properties of the a 
indicates that for most of the surviving points in the nMSSM and the NMSSM, its dominant 
component is the singlet field (numerically speaking, cos 9 a > 0.7) so that its couplings to 



the SM fermions are suppressed 15|,ll9|. Our analysis also indicates that the main decay 



n 



products of a are tt for the L2HDM 20J], bb (dominant) and tt (subdominant) for the Type- 
II 2HDM tl 
nMSSM[19fl. 



II 2HDM, the nMSSM and the NMSSM, and in some rare cases, neutralino pairs in the 
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FIG. 5: Same as FigJH but for the branching ratio of Z — > bba versus m a . 
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In FigJU we project the surviving samples on the m a — tan/3 plane. This figure shows 
that the allowed range of tan/3 is from 8 to 20 in the Type-II 2HDM, and from 37 to 80 
in the L2HDM. Just as we introduced before, the lower bounds of tan/3 come from the 
fact that we require the models to explain the muon anomalous moment, while the upper 
bound is due to we have imposed the constraint from the LEP process e + e~ —¥ bbS — > 4b, 
which have limited the upper reach of the bbS coupling for light S 33j (for the dependence 
of bbS coupling on tan/3, see Sec. II). This figure also indicates that for the nMSSM and 
the NMSSM, tan/3 is upper bounded by 10. For the nMSSM, this is because large tan/3 
can suppress the dark matter mass to make its annihilation difficult (see [19( and also Sec. 
II), but for the NMSSM, this is because we choose a light slepton mass so that large tan/3 
can enhance a M too significantly to be experimentally unacceptable. We checked that for 
the slepton mass as heavy as 300GeV, tan/3 > 25 is still allowed for the NMSSM. 
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In Figj5] and Figj6j we show the branching ratios of Z — y bba and Z — y fra respectively. 
Figj5] indicates, among the four models, the Type-II 2HDM predicts the largest ratio for 
Z — y bba with its value varying from 5 x 10~ 6 to 6 x 10~ 5 . The underlying reason is in the 
Type-II 2HDM, the bba coupling is enhanced by tan/3 (see FigH]), while in the other three 
model, the coupling is suppressed either by cot /3 or by the singlet component of the a. Figj6] 
shows that the L2HDM predicts the largest rate for Z — y fra with its value reaching 1CT 4 
in optimum case, and for the other three models, the ratio of Z — y fra is at least about 
one order smaller than that of Z — y bba. This feature can be easily understood from the 
fra coupling introduced in Sect. II. Here we emphasize that, if the nature prefers a light a, 
Z — y bba and/or Z —y fra in the Type-II 2HDM and the L2HDM will be observable at the 
GigaZ. Then by the rates of the two decays, one can determine whether the Type-II 2HDM 
or the L2HDM is the right theory. On the other hand, if both decays are observed with 
small rates or fail to be observed, the singlet extensions of the MSSM are favored. 

In Fig JTJ we show the rate of Z — y a^ as the function of m a . This figure indicates that 
the branching ratio of Z — y 07 can reach 9 x 10~ 9 , 6 x 1CT 10 , 9 x 10 -11 and 4 x 10~ 10 for the 
optimal cases of the Type-II 2HDM, the L2HDM, the nMSSM and the NMSSM respectively, 
which implies that the decay Z — y cry will never be observable at the GigaZ if the studied 
model is chosen by nature. The reason for the smallness is, as we pointed out before, that 
the decay Z — y 07 proceeds only at loop level. 

Comparing the optimum cases of the Type-II 2HDM, the nMSSM and the NMSSM shown 
in Fig. 5-7, one may find that the relation Bt 2 hdm > Bvnmssm > Br nMSSM holds for any of 
the decays. This is because the decays are all induced by the Yukawa couplings with similar 
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structure for the models. In the supersymmetric models, the large singlet component of 
the light a is to suppress the Yukawa couplings, and the a in the nMSSM has more singlet 
component than that in the NMSSM. 

Next we consider the decay Z — ¥ aaa, which, unlike the above decays, depends on 
the Higgs self interactions. In FigJS] we plot its rate as a function of m a and this figure 
indicates that the Br(Z — > aaa) may be the largest among the ratios of the exotic Z decays, 
reaching 10 -3 in the optimum cases of the Type-II 2HDM, the L2HDM and the nMSSM. The 
underlying reason is, in some cases, the intermediate state h in Figj3] (a) may be on-shell. 
In fact, we find this is one of the main differences between the nMSSM and the NMSSM, 
that is, in the nMSSM, h in Figj3] (a) may be on-shell (corresponds to the points with large 
Br(Z — y aaa)) while in the NMSSM, this seems impossible. So we conclude that the decay 
Z —y aaa may serve as an alternative channel to test new physics models, especially it may 
be used to distinguish the nMSSM from the NMSSM if the supersymmetry is found at the 
LHC and the Z —y aaa is observed at the GigaZ with large rate. 

Before we end our discussion, we note that in the NMSSM, the Higgs boson a may be 
lighter than lGeV without conflicting with low energy data from T decays and the other 
observables (see FigHHH]). In this case, a is axion-like as pointed out in [lo j. We checked 
that, among the rare Z decays discussed in this paper, the largest branching ratio comes 
from Z — y abb which can reach 1.9 x 10~ 6 . Since in this case, the decay product of a is 
highly collinear muon pair, detecting the decay Z —y abb may need some knowledge about 
detectors, which is beyond our discussion. 
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VI. CONCLUSION 

In this paper, we studied the rare Z-decays Z — » ffa (/ = b,r), Z — >■ 07 and Z — >■ aaa in 
the Type-II 2HDM, lepton-specific 2HDM, nMSSM and NMSSM, which predict a light CP- 
odd Higgs boson a. In the parameter space allowed by current experiments, the branching 
ratio can be as large as 10~ 4 for Z — y ffa, 10 -9 for Z — y 07 and 10 -3 for Z —y aaa, which 
implies that the decays Z —y ffa and Z —y aaa may be accessible at the GigaZ option. 
Since different models predict different size of branching ratios, these decays can be used to 
distinguish different model through the measurement of these rare decays. 
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